/u/xJRWR's /r/Imposter Database of DOOM!
JSON Export

Fields Explained

id = AutoIncr ID, Seq
answer = submitted "answer" from the userscript as seen by the end users
source = SHA1($salt.$IPAddress_v4_v6), The Salted SHA1 Hash of the users IP Address that submitted the data
flag = If the answer was submitted to the reddit API, this is also saved for all other rows from the same session for "result"
result = The response from the reddit API if the chosen text is a Imposter, To explain: Flag = 1 AND result = WIN, That row is a imposter, All others in the session /might/ be humands, If flipped, that answer was confirmed human (FLAG =1 AND LOSE), INVAILD is when the reddit API failed to respond.
session = hex encoded "sessionid" made using '$session = bin2hex(time().random_bytes(5));' then hex encoded back into the json for ease of export. These are set per batch submission, so there is one set for every game
uuid = the answer uuid as provided by reddit.
question = The first question reddit used, (0 was "What makes you human?" 1 was "Can you recognize it in others?") This was a clean cutoff as reddit stopped running for several minutes.
notweet = Not Used (Its for my twitter bot)
timestamp = Mysql Timestamp, NTP Sync'd (I think its UTC)

All data was saved from userscripts. Some entries may be fake as end users where trying to spoof this database. JRWR Suspects that this was late game and less then 1% of the data was "posioned"

To Outline the event, 4 Questions are Human, 1 is bot generated (GPT-2 we think). We stored everything Seen, so in a single session, 1 Confirmed (Submitted to the API) and the rest unconfirmed, but the "result" of the unconfirmed is stored with the rest.

We did this so autoselection bots would have more data to work with. and it worked really well, 98% Detection rates of imposters was normal near the end. This also means there are TONS of duplicates in the database. but thats OK


Questions? Email me at: reddit-imposter@jrwr.io, or Tweet me on Twitter @JRWR


Cool Stats so far
    Currently storing 27,298,899 rows and current size is 5,167MiB
    Total Humans: 680,666
    Total Imposter: 5,370,125
    Total Users submitting data: 550
    Total games/rooms: 5,459,802
    Invaild games submitted: 28

    Top 3 Users submissions
            User 1 [c67b]: 1,521,875
            User 2 [d06d]: 883,394
            User 3 [dc15]: 795,396
    Top 5 seen answers
            it was my programmers. - 841 Times
            i don't know, an imposter would though. - 826 Times
            am robot not human with heart. - 809
            the perception that there's something to pretend to be. - 764
            i have reddit and instagram and tiktok. - 772




==== PHP CODE USED TO EXPORT THE JSON ====

$x = 0;

while($x <= 5000000000000000) {
$datas = $database->select("maintable", "*",
[
        'LIMIT' => [$x, 50000],
]
);
foreach($datas as $key => $row){
$datas[$key]["session"] = bin2hex($datas[$key]["session"]);
}
if(empty($datas[0])){die();}
file_put_contents("/var/www/html/export/$x.json", json_encode($datas, JSON_HEX_TAG | JSON_HEX_APOS | JSON_HEX_QUOT | JSON_HEX_AMP | JSON_PRETTY_PRINT));
echo ".";
$x = $x + 50000;
}

==== EOF ====

==== PHP CODE TO STORE THE DATA INTO THE MYSQL DB ====

if(empty($_POST)){die();}
if(empty($_POST["answer"])){die();}
if(empty($_POST["result"])){die();}
if(empty($_POST["room"])){die();}
if(empty(json_decode($_POST["room"]))){die();}
require 'Medoo.php';
use Medoo\Medoo;

$database = new Medoo([
        'database_type' => 'mysql',
        'database_name' => 'all-store',
        'server' => 'localhost',
        'username' => 'website',
]);
include_once('SSDB.php');
try{
    $ssdb = new SimpleSSDB('127.0.0.1', 8888);
}catch(Exception $e){
    die(__LINE__ . ' ' . $e->getMessage());
}

$session = bin2hex(time().random_bytes(5));
$json = json_decode($_POST["room"], true);
foreach($json["options"] as $row){
if(trim($row[1]) == trim($_POST["answer"])){
$flag = 1;
}else{
$flag = 0;
}

$database->insert('maintable', [
    'answer' => trim($row[1]),
    'uuid' => $row[0],
    'source' => sha1("asldkhaskjh1kh23asd".$_SERVER['REMOTE_ADDR']),
    'result' => $_POST["result"],
    'flag' => $flag,
    'question' => 1,
    'session' => hex2bin($session),
]);
$id = $database->id();
$datas = $database->select("maintable", ["id", "answer", "flag", "result", "uuid"], ["id" => $id]);
$ssdb->hset($datas[0]['uuid'], $datas[0]['id'],json_encode($datas[0]));
}
echo json_encode($datas);

==== EOF ====
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